A Comparison of Small Crowd Selection Methods
نویسندگان
چکیده
The literature on the wisdom of crowds argues that in most situations, the aggregated judgments of a large crowd perform well relative to the average individual. There are, however, many real-world cases where crowds perform poorly. A small crowd literature has since developed, finding that better performing small crowds often exist within whole crowds. We compare previously proposed small crowd selection methods based on absolute or relative group performance to a new sequential search method and find that it selects better performing small crowds more consistently for forecasts of real gross domestic product (GDP) growth, inflation (measured by consumer price index, CPI), and unemployment rate made by US and Euro-zone surveys of professional forecasters.
منابع مشابه
Perform Three Data Mining Tasks with Crowdsourcing Process
For data mining studies, because of the complexity of doing feature selection process in tasks by hand, we need to send some of labeling to the workers with crowdsourcing activities. The process of outsourcing data mining tasks to users is often handled by software systems without enough knowledge of the age or geography of the users' residence. Uncertainty about the performance of virtual user...
متن کاملFeature Selection for Small Sample Sets with High Dimensional Data Using Heuristic Hybrid Approach
Feature selection can significantly be decisive when analyzing high dimensional data, especially with a small number of samples. Feature extraction methods do not have decent performance in these conditions. With small sample sets and high dimensional data, exploring a large search space and learning from insufficient samples becomes extremely hard. As a result, neural networks and clustering a...
متن کاملCrowd-Squared: A New Method for Improving Predictions by Crowd-sourcing Google Trends Keyword Selection
Advances in information technologies and analytic tools have dramatically increased our ability to obtain accurate data on billions of economic decisions almost the instant that they are made. Services such as Google Trends aggregate billions of search queries and provide information about the search volume of different terms. This information from the “crowd”, had been successfully used to acc...
متن کاملDecember: A Declarative Tool for Crowd Member Selection
Adequate crowd selection is an important factor in the success of crowdsourcing platforms, increasing the quality and relevance of crowd answers and their performance in different tasks. The optimal crowd selection can greatly vary depending on properties of the crowd and of the task. To this end, we present December, a declarative platform with novel capabilities for flexible crowd selection. ...
متن کاملA Data-driven Method for Crowd Simulation using a Holonification Model
In this paper, we present a data-driven method for crowd simulation with holonification model. With this extra module, the accuracy of simulation will increase and it generates more realistic behaviors of agents. First, we show how to use the concept of holon in crowd simulation and how effective it is. For this reason, we use simple rules for holonification. Using real-world data, we model the...
متن کامل